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In an evaluation of a language arts program for oral and written facility and 
comprehension among children of an urban culture. 262 children in kindergarten 
comprised the experimental group, and 369 students served as controls. Children in 
both groups were presented with three pictures and instructed to tell a story about 
each. Observers rated speech facility and overall verbalization. Pretests and 
posttests were given to both groups. The results showed that students m 
experimental schools do significantly better in word meaning, language facility, picture 
vocabulary, and the Merrill-Palmer bcale and relatively better on English Error Score 
and in reading than their readiness score predicted. They made significantly fewer 
errors on the Dailey Language Facility Test. School characteristics and school 
success were compared with data from another study. It was found that teachers 
salaries, teachers’ experience, number of books in the school library, and per-pupil 
expenditure are more closely related to school success than are school size, average 
class size, age of building and suburban location. Family income was most closely 
related. The language arts program was found to be needed and successful and 
should be extended to the prekindergarten level. A reevaluation should be made in a 
few years. (JS) 






c 



7.1 * 



WELFARE 



: * ' ■ 



'..•''r-i r V, 



' l''S RECf |’,TD rc:r-,; 

, ■_ ■• ' - 1 i'L'.''LjoVilu:y fr' VI V,; OR opi.-t- 
"-•■iOiI I.R f'^LlOY. ■ • ^■'^U L[fiCL OF EDUC\]:r';' 



VU 



M EVALUATION OF THE LANGUAGE ARTS PROGRAM 
OF THE DISTRICT OF COLUMBIA 



Final Report 
on 

Contract N . S . 2682 

Government of the District of Columbia 



CO 

iH 

o 

02 

PU 



John T. Dailey 
Responsible Investigator 

Clinton A. Neyman, Jr. 
Assistant 



The George Washington University 
Education Research Project 

Noveiiiber, I965 








The George Washington University 
Education Research Project 
November, 19^5 



An Evaluation of the Language Arts Program 
of the District of Columbia 

Final Report 



A. Introduction 

The Language Arts Program of the District of Columbia Public Schools 
was design^to develop the oral and written language facility and com- 
prehension of culturally different children in the L 

nrimarv, first, second, and third grade levels from 19&1 "’J-n 

?™;; Lementary scLols in the District of Coltmhaa ^^is 

the establishment of summer educational centers for streriKth- 

For one summer, weak first and second graders were enrolled for strength 

ening in the area of language development, toother ^ f 
enrolled vreak kindergarten children, who, after a year in tha g , 
were considered to be poor risks for first grade. During th p 
two summers, it consisted of a preschool l“S>iage-oriented program for 
bovs and girls who were registered for kindergarten or grade one of the 
next school year. The major emphasis was placed on the deve . 

a iLguage Jts program that would overcome the ^ 

characteristic of culturally different children. Its P ^ 
essentially, is to teach English to those children who, in effect, 
speak an urban dialect and not standard English. 

B. The Procedure 

An evaluation study of the Language Arts ^°8ram has been c^rie^ 
out by the Education Research Project of The George Washington University. 
There were approximately 600 children in kindergarten in sev^scto^^ 
which comprised the Language Arts Program during ^^e school year of 
loAi to The 263 students from this group who were still enrolled in 
n?™‘schoolfLSed tto experimfntal group. For the control ^'oup 
the* students in eight similar District of Columbia elementary schools 
have beerstuSed.* In these schools there 369 

similar to the experimental group in that they had been in 
since kindergarten in I96I-62. The control schools ^ 

the variables developed by Mr. Harry B. Merican for use in his Impact 

Aid Study of the D.C. Public Schools. 

The following test scores and other variables were available on 
students in both the experimental group and the control group: (l) Metro- 

politan Reading Readiness Test; (2) Metropolitan Achievement Test, 

(3) Stanford Achievement Test; (^) Teacher ratings on qua i y 
work, motivation, getting along with other children, and how the home 
situation affected the student’s work. 



In program schools the i;otal scores and suh-scores 
the Gates Reading Tests on students in grades 1, 2, and 3. In addition, t 
n=^»5 TL^^e Facility Test was administered to the students in both the con- 

“ sr=’.s 

‘“r* s^i 2S.rs's«s.rS"*tS 

of 2k types of major errors in pronunciation or usage. 

The Dailey ^^^Xin^s^fooH^^^^ 
rr^dSdiSf sample of speech in ten S^e“tiver"insenIitL 

Tt^rex o^ =fg-:p :fX“™a^Lr ihl-su^^ec? if ashed ^o. tell a 
slo^l; aCt Iac“?^fe pictures of the series. Each story or description 
is then scored on a nine-point scale as follov7s. 

STORY SCORE SCALE 

Score Description 

A good story with imagination and creativity 

c^Iele story with some elements of past or future action or indention 

1 _A detailed description of what is happening, hut no story about past 

5 SrftC of 'sLIIncf wltflLe elements of interpretation of movement 

h Morfthf one sentence, but no interpretation of movement or action 

sentence that makes sense 

2 Compound responses, two or more words at a time, a single wor 

describing action, or more than one single-noun response 

l------One single-noun response ^ . • a. 

0 — — --No response -- garbled speech, or only poin s a pic ure 

The seal?' values are completely independent of vocabul^y, 

The protocols can also be scored for frequency of each major type of error 
in pronunciation or grammar according to the code as follcn^s: 
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GT/illDAPvP-roLISH SCOnBIG SCALE 



Code Dc-.c:.i -cion of Q^, 

A Simple verb, wrong number 
B Auxiliary verb, wrong number 

C Auxiliary verb omitted 

D Wrong past participle 
E s on plural not ending in s 
F Incorrect irregulcur plural 
G a for an 
H got for have or has 
I Letters interchanged (t for d, 

1 ^*0^ i) 

J g on ing pronounced 

K in* for ing 

L picture mispronounced 

M airplane mispronounced 

N Consonants slurred 

0 Unaccented vowel sliirred 

P Verb tense changed in sentence 

Q Number of verb agreeing with 
incorrect subject 
R they for there or their 

S d, t , or V for 

T £ on possessive noun omitted 

U i omitted 

V ^ for a, T& for ^ 

W diphthongized vowels 

X Elongated, distorted vowels 

Y Other comments (please specify): 



Examples of Error- 



she want; they sees 

he have waited; she are going 

he running 

wore (worn); came (come); flew (flown) 

chilluns (children); geeses 

shelfs 



boddle (bottle); laty (lady) 

runnin* 

pitcher 

arruplanej erroplane 
chillun (children) 
fam*ly; an*mal 

She is getting up and then she got 
dressed. 

The duck and the gull is flying, 
they shoes 

nuttin* (nothing); muddah (mother) 

lady* watch 

litta gir*; gi*l 

bleck (black) 

bayid (bed) 

tShde (tired); bade (bed) 
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The Peabody Picture Vocabulary Test and a verbal subtest from the 
Merrill-Palmer Action Agent Scale were also administered to sub-samples of 100 
students each in the experimental and control schools. 

C. Findings 

1. Table 1 below compares the performance of children in the experimental 
school with those in the control schools. It can be seen that the control 
schools have slightly higher income and as a result tend to do better on some of 
the tests. However, the right-hand column "adjusted ‘z* score shows comparisons 
VThere the effect of the income difference has been removed. This represents the 
only legitimate comparison of the measures. It can be seen that the experimental 
schools exceed the control schools in word meaning, language facility, picture 
vocabulary, and Merrill-Palmer Scale. The experimental schools do relatively 
better in reading than their original reading readiness would have indicated. 

The experimental schools particularly excel, on the English Error Score. 

2. The students in the Language Arts Program Schools made significantly 
fewer errors in their speech samples on the Dailey Language Facility Test than 
did the control group. This was true at the levels (high, medium, and low) 

of language facility as measured by the nine-point scale on the test. VHien 
the e:q>erimental and control groups were compared on the inc:„dence of eight 
major categories of speech errors at each of three levels of langu^e facility, 
the experimental group did better in l8 out of 2k comparisons. This is signifi- 
cant at the one percent level. 

3. A factor analysis was carried out relating the regular language 
facility scale score on the tests and the various error scores to such variables 
as sub-scores on the Metropolitan Readiness Test, the Peabody Hcture Vocabulary 
Test, sub-scores on the Stanford Achievement Test, teacher ratings on quality of 
homework, motivation, getting along with other children, effect of home 
situation, as well as grade, sex, and age. Three factors emerged from the 
speech sample. One was defined by the nine-point language facility scale score, 
one appeared to be a cluster of errors in pronunciation, and the third appeared 
to be a cluster of errors in structure or grammar. With further refinement 

the error code should become quite useful in measuring different g,spects of 
dialects and for evaluating various methods of dialect transformation. 

School Characteristics vs. School Outcomes 

With Project Talent* data several studies have been made of the relation- 
ships between many school practices and many school outcomes. It is not 
possible to obtai.n absolute proof of cause and effect relationships fircm 
Project Talent data nor any other similar statistical data based on relating past 
measures of behavior with each other. For example, it is not possible to ^ 
prove unequivocally by statistical survey methods that higher teacher salaries 



*John T. Dailey, "Study of the Relationships between Characteristics 
of Project Talent Schools and the Amount of Impact Aid Received," Entitlemen;^ 
for Federally Affected School Dist rictrS under Public Laws 8?4 and 8,15. by 
Robert G. Spiegelman, et al., for U.S‘. Department of Health, Education, and 
Welfare. (Menlo Park, California; Stanford Research Institute, May, 1965) 
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*A negative "z" score indicates that the control school scores higher than the experimental schools 
based upon the standard deviation of the control schools. 

**Based upon the median income of the census tract in which the schools are located. 




cause higher school achievement. On the other hand, it is possible to do 
analyses that make it appear quite likely that these higher salaries may e 
one of the most important factors in obtaining higher achievement. At the 
same time, it is possible to use equivalent methods to indicate that it seems 
very unlikely that size of school as such is a necessary prerequisite for high 
achievement because there is no associational evidence at all m this direction 
when all factors are considered. A given factor is extremely unlikely to be 
a causative factor if it shms no unique association with measures of school 
performance in a comprehensive set of data where the other important factors are 

being held constant. 

The Project Talent data to date seem to indicate that four school factors 
most closely and uniquely associated with school outcomes such as achievemen 
and going to college and staying in school are: 



Teacher salaries 
Teacher experience 

Number of books in the school library 
Per-pupil expenditure 

It should be cautioned that we cannot conclude for sure that these 
factors are causing the differences in school outcomes. It may be that "tbey 
are caused b'^r some outside factors which are just being mirrored or reflected 
by these above measures. Nevertheless, their relationship is substantial even 
after as many as 30 of the most important school and community characteristics 
have been held constant in mathematical analyses. 

On the other hand, we can be much more confident in concluding that many 
other factors are not likely to be prime causes of school excellence since 
they do not have any sizable \inique correspondence with school outcomes. The 
data in Project Talent indicate that some school characteristics seem very 
unlikely to be prime causes of school excellence of output. Among these 

seem to be: 



School size 

Average size of classes 
Age of building 
Suburban location 

A similar study was made of the 129 elementary schools in the District 
of Columbia. It was found that the variable which was most closely related 
to school performance was the median family income for the census tract in 
which the school was located. The higher the median income the hi^er the 
achievement, and the lower the income the lower the achievement. This variable 
stood out above all others. The school performance was measured by the per- 
centage of the fourth-grade students scoring below the national J^orm in the 
Reading Test of the Metropolitan Achievement Battery in 1963-64. The second 
most important factor which contributed to high performance when all other 
variables were held constant is low rate of non-promotion within schools. 

Among the other variables the ones most closely related to reading were the 
presence of a librarian and having participated in the Language Arts Program. 
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In addition, similar analyses were made to predict achievement in Word 
Knowledge, Arithmetic, and Total Language performance, all of which yielded 
similar patterns, with high median income coming out first, followed to a 
much lesser degree by low rate of non-promotion within the school. 



One of the least useful variables in this study was median years of 
education of the adult population in the census tract. This is to be e^^cted 
since mnny studies, particularly Lroject Talent, have shown that high schools 
differ tremendously in their levels of achievement. This makes grade completed 
a very inaccurate measure of the actual level of education. 

It is of considerable interest that in this study ethnic data about the 
composition of the student body or the school staff were not needed to predic 
achievement with a high degree of accuracy. The use of the median 
income level by itself predicts performance about as \ieU. as any combination oi 
all the available socio-economic and educational variables. Such factors as 
gross expenditure rate in each specific school and degree of overcrowding in 
the school bore little relationship to school achievement in schools with the 
same levels of parental income. This was also true of the age of the school 
building. The general pattern of the findings was extremely similar to those 
in the studies of the national samples of high schools in Project Talent. 



D. Conclusions 

1. The Language Arts Program appears to be an effective way of helping 
culturally different children increase their language skills and learn to use 
standard English with greater accuracy. It should be continued and intensified. 
Instead of one extra teacher, there should be two or more. As it has been 
operating, the child has been exposed to the new learning experiences oJLy a 
small part of his time. In the remainder of his time, he has been reinforced 
in his dialect by hearing it continuously spoken by the other children and 

by adults outside of school. An expanded Language Arts Progr^ should be an 
excellent investment and it is recommended that it be given high priority. 

2. However, even an expanded Language Arts Program cannot by itself 
fully solve the problem of teaching standard English to these culturally 
different children. By the kindergarten age they have so thoroughly learned and 
Over—Xearned all the wrong \vays of using English that it is most diificult for 
many of them to un- learn their mistakes and then learn standard English later 

in the regular school program. There should be a pre-kindergarten program for 
these children starting at the earliest possible age and stressing the types 
of experiences offered in the Language Arts Program. The primary objective of 
the preschool program should be to help the children to learn to speaJc standard 
English. If this can be done, it will greatly simplify their later problems 
in reading, English expression, and vnriting. 

3 . The experimental group should again be evaluated in the sixth grade 
to see how the effects of having been in the Language Arts Program have held 
up at higher levels. It would also be worthwhile to locate and test those who 
started in the program and are no longer in the program schools. 
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